Some upper bounds for relative entropy and applications
نویسندگان
چکیده
منابع مشابه
Relative Entropy Derivative Bounds
We show that the derivative of the relative entropy with respect to its parameters is lower and upper bounded. We characterize the conditions under which this derivative can reach zero. We use these results to explain when the minimum relative entropy and the maximum log likelihood approaches can be valid. We show that these approaches naturally activate in the presence of large data sets and t...
متن کاملSome Upper Bounds on the Inverse Relative Dimension/Length Profile
The generalized Hamming weight played an important role in coding theory. In the study of the wiretap channel of type 11, the generalized Hamming weight was extended to a two-code format. Two . equivalent concepts of the generalized Hamming weight hierarchy and its two-code format, are the inverse dimension/length profile (IDLP) and the inverse relative dimension/length profile (IRDLP), respect...
متن کاملNew Upper Bounds for Maximum - Entropy Sampling
We develop and experiment with new upper bounds for the constrained maximum-entropy sampling problem. Our partition bounds are based on Fischer's inequality. Further new upper bounds combine the use of Fischer's inequality with previously developed bounds. We demonstrate this in detail by using the partitioning idea to strengthen the spectral bounds of Ko, Lee and Queyranne and of Lee. Computat...
متن کاملUpper Bounds on Fourier Entropy
Given a function f : {0, 1} n → R, its Fourier Entropy is de ned to be −∑S f̂(S) log f̂(S), where f̂ denotes the Fourier transform of f. This quantity arises in a number of applications, especially in the study of Boolean functions. An outstanding open question is a conjecture of Friedgut and Kalai (1996), called Fourier Entropy In uence (FEI) Conjecture, asserting that the Fourier Entropy of any ...
متن کاملUpper and Lower Bounds on Gravitational Entropy
The gravitational entropy of the Universe is large and subtle to calculate. A lower bound is well known from supermassive black holes at the centers of galaxies, but the remainder is harder to pin down. A parametric model of clumped matter entropy is provided. We suggest a new upper bound due to dark matter halos, that is far below the holographic bound, yet above that for the supermassive blac...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Computers & Mathematics with Applications
سال: 2000
ISSN: 0898-1221
DOI: 10.1016/s0898-1221(00)00089-4